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THE  PRINCIPAL  PIVOTING  METHOD  REVISITED 
by  Richard  W.  COTTLE 

ABSTRACT 

The  Principal  Pivoting  Method  (PPM)  for  the  Linear  Complementarity  Prob¬ 
lem  (LCP)  is  shown  to  be  applicable  to  the  class  of  LCPs  involving  the  newly 
identified  class  of  sufficient  matrices. 


1.  Background 


The  classes  of  row  sufficient  and  column  sufficient  matrices  were  recently  introduced  in  a 
paper  byyCottle,  Pang,  and  Venkateswaran,[6].  It  was  shown  there  that  such  matrices  pro¬ 
vide  answers  to  natural  theoretical  questions  concerning  the  linear  complementarity  prob¬ 
lem  (LCP).  Further,  on  the  algorithmic  side,  it  was  noted  that  Lemke’s  Method  (Scheme 
1 )  [9]  for  the  LCP  can  “process”  any  problem  in  which  the  matrix  is  row  sufficient.  In  fact, 
by  a  theorem  of  Aganagic  and  Cottle' [1),  the  latter  is  true  for  any  Qo-matrix  having  non¬ 
negative  principal  minors,  and  row  sufficient  matrices  are  of  this  sort.  These  observations 
prompt  one  to  ask  whether  the  principal  pivoting  method  (PPM)43],  [7],  [5],  [3]  is  also 
applicable  to  this  class  of  LCPs.  This  question  is  especially  relevant  inasmuch  as  the  kinds 
c'f  matrices  that  the  principal  pivoting  method  can  handle  have  heretofore  been  limited 
to  P-matrices  and  positive  semi-definite  (PSD-)  matrices,  both  of  which  types  are  row 
sufficient  as  well  as  column  sufficient.  Thus,  a  demonstration  that  the  PPM  can  process 
LCPs  with  row  sufficient  matrices  amounts  to  a  unification  of  the  existing  theory  of  the 
PPM  and  an  extension  of  its  scope.  Such  is  the  main  goal  of  the  present  paper. 

Let  us  begin  by  fixing  notation  and  reviewing  some  terminology.  Given  a  column  vector 
q  6  /?'"  and  a  matrix  M  G  the  pair  (q,M)  specifies  a  linear  complementarity  problem  ,■■■"  "C 

(of  order  n)  through  the  system 

>  0, 
q  -I-  AIz  >  0, 
z'^iq  +  Mz)  =  0. 


.4n  alternate  fornmlation  of  (ry.  A/)  is  to  find  vectors  u\  z  satisfying 


ie  =  q  +  M z,  w  >0,  ^  >  0,  =  0. 


This  systf'in  involves  n  pairs  of  cmriplcmentary  variable.,^  ir,  and  z,  for  i  —  1 . ii.  The 

niemljers  of  a  complementary  pair  of  valuables  are  said  to  be  coniplcmrnt..*  of  each  other. 


1 


□  □ 


To  process  the  linear  complementarity  problem  {q,M)  means  to  obtain  a  solution  (i.e.,  a 
vector  c  satisfying  (1)  -  (3))  or  to  demonstrate  that  the  problem  has  no  solution.  Dis¬ 
cussions  of  the  processing  capabilities  of  various  linear  complementarity  algorithms  usually 
focus  on  properties  of  matrix  classes.  For  instance,  it  is  known  that  the  principal  pivoting 
method  will  process  any  LCP  (g,M)  when  M  is  a  P-matrix  (i.e.,  has  positive  principal 
minors)  or  when  M  is  PSD,  (i.e.,  x^Mx  >  0  for  all  x).  In  the  former  case,  (q^M)  must 
always  have  a  unique  solution — regardless  of  what  q  equals— and  the  PPM  will  find  it.  In 
the  latter  case,  the  LCP  will  always  have  a  solution  provided  the  constraints  (1)  and  (2) 
are  consistent.  (The  matrices  having  this  property  form  a  class  denoted  Qo-)  When  M  is 
a  positive  semi-definite  matrix,  the  PPM  will  find  a  solution  of  any  LCP  (q,  M)  or  detect 
that  the  corresponding  inequalities  (1)  and  (2)  are  inconsistent. 

The  matrix  classes  P  and  PSD  are  complete  in  the  sense  that  they  contain  all  principal 
submatrices  of  all  their  members.  Furthermore,  the  matrix  classes  P  and  PSD  are  distinct 
but  not  disjoint.  Consequently  (by  the  completeness  property),  if  M'  is  a  P-matrix  that  is 
not  positive  semi-definite,  and  M"  is  a  positive  semi-definite  matrix  that  does  not  belong 
to  P,  then  their  direct  sum,  the  block  matrix 

V=("'  “  V 

\  0  M"  ) 

belongs  to  neither  of  these  classes,  yet  the  PPM  will  process  the  LCP  {q,M)  where 


because  it  decomposes  into  the  problems  (q\M')  and  {q",M'')  each  of  which  can  be  pro¬ 
cessed  by  the  PPM.  So,  in  a  sense,  it  is  incorrect  to  think  of  the  PPM  as  being  limited  to 
LCPs  (q.M)  with  M  G  P  or  M  6  PSD. 

Although  their  basic  definitions  are  quite  different,  the  classes  P  and  PSD  are  subclasses 
of  Pq  the  elements  of  which  arc  the  matrices  with  nonnegativc  principal  minors.  Unfortu¬ 
nately,  the  class  Pq  is  too  large  for  purposes  of  LCP  theory  or  algorithms.  In  this  pa])cr, 
our  attention  will  renter  on  a  cla.s.s  of  matrices  that  contains  P  and  PSD,  3’et  is  contained 
in  Pn^Qj).  (The  subclass  PoHQq  was  characterized  in  [1].)  This  intermediate  class  consists 
of  the  "row  sufficient"  matrices  whose  definition  we  recall  in  the  next  section  along  with 
the  definitions  of  two  related  matrix  classes. 

The  plan  for  th<'  remainder  of  this  paper  is  as  follows.  Section  2  contains  the  definitions 
of  row  and  column  sufficient  matrices  and  an  example  Section  .'t  gi'-ec  cnine  ,  ^  d'eir 
elementarv'  pro])erties.  Section  4  focuses  on  the  operation  known  as  principal  pivoting  and 
estaldishes  some  invariance  theorc'ins  needed  for  the  PPM.  Section  5  jiresents  the  iirincipal 
[dvf;ting  method  for  LCPs  with  row  sufficient  matrices. 
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2.  Definitions  and  an  example 

For  ease  of  reference,  we  recall  what  is  meant  by  row  (and  column)  sufficient  matrices. 
Definition.  The  matrix  M  G  is 

(i)  row  sufficient  if 

Xi{M^x)i  <  0  for  all  i  =  1, . . .  ,n  =>  Xi(M^x)i  =  0  for  all  i  =  1, . . . ,  n,  (4) 

(ii)  column  sufRcient  if 

Xi{Mx)i  <  0  for  all  i  =  1, . . .  ,n  Xi(Mx)i  =  0  for  all  i  =  1, . . .  ,n,  (5) 

(iii)  sufRcient  if  it  is  row  and  column  sufficient. 

In  dealing  with  the  above  properties,  it  is  sometimes  handy  to  use  the  notion  of  the 
Hadamard  product  of  vectors  (or  matrices).  If  u  €  ii"  and  u  G  ii",  their  Hadamard  product 
is  the  vector  u  *  u  G  ii"  defined  by 


{u  *  v)i  =  Ui  •  Vi  i  =  1, . . . ,  n. 

To  apply  this  notion  to  the  definition  of  a  column  sufficient  matrix,  we  let  u  =  x  and  v  = 
Mx.  Then  the  defining  condition  is 

x*(Mx)<0  x*{Mx)  =  0. 

In  the  case  of  a  row  sufficient  matrix,  the  defining  condition  is 

X  ♦  (M^x)  <  0  ==>  X  *  (M^x)  =  0. 

Example  1.  The  3x3  matrix 


M  = 


(  ^ 
2 

\  -1 


-1  2  \ 

0  -2 

1  0  / 


i.s  ji.ot  in  the  class  P  since  it  has  zeros  on  its  diagonal.  These  same  zeros  and  the  rnn'^'-ro 
I  lep'^'n*-  i:i  *heii  rows  and  columns  prevent  the  matrix  from  being  row  or  column  adequate 
(in  the  sense  of  Ingleton  [8]).  Furthermore,  the  matrix  is  not  PSD,  for  wla'iiever  such  a 
positive  sen.i-definite  matrix  has  a  zero  (say,  m„)  on  its  diagonal,  the  sum  of  corresponding 
off-fliagonal  entries  (m.j  and  rUj,)  must  equal  zero,  which  is  not  true  in  this  case.  It  is  ch'ar 
that  the  matrix  M  is  not  the  direct  sum  of  matrices  of  these  three  kinds.  eitlxT. 


The  matrix  M  is  sufficient,  however.  To  .see  this,  suppo.se  x  G  /?’  is  a  vector  such  that 
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Then 


X  *  (Mx)  <  0. 


— I1Z2  +  2IiZ3  <0 
2Zil2  —  2X2^3  <  0 
-IlX3  +  X2X3<0 


These  inequalities  imply 


2X3X3  ^  2X1X3  ^  X1X2  ^  X^X;). 

Hence 

max{xiX2,x:iX3,X2X3}  <  0. 

Each  of  these  three  products  being  nonpositive,  the  variables  must,  pairwise,  be  of  opposite 
sign.  But  there  are  only  two  signs  to  share  among  three  variables,  so  it  follows  that  at  least 
one  of  xi,X2,X3  equals  zero.  It  is  now  easy  to  verify  that  for  z  =  1,2,3 

X,  =  0  =>  n  Xj  =  0  =>•  X  *  (Mx)  =  0. 

This  shows  that  M  is  column  sufficient  The  same  type  of  argument  applied  to  can  be 
used  to  demonstrate  that  M  is  row  sufficient  Accordingly,  M  is  sufficient  as  asserted. 

This  example  shows  that  sufficient  matrices  are  different  from  P-matrices,  adequate  ma¬ 
trices,  and  PSD-matrices.  But  could  they  be  positively  scaled  versions  of  such  things? 
That  is,  do  there  exist  diagonal  matrices  A  and  with  positive  diagonal  elements  such 
that  M  ;=  AMQ  belongs  to  one  of  the  aforementioned  cleisses?  The  answer  is  clearly  in 
the  negative  for  the  classes  of  P-matrices  and  adequate  matrices.  We  shall  now  show  that 
the  PSD  case  can  also  be  ruled  out. 


For  the  matrix  M  given  above,  suppose  there  exist  positive  definite  diagonal  matrices 
A  =  Diag  (A] ,  A2,  A3)  and  Cl  =  Diag(u;i,u'2,u;3)  such  that  M  :=  AMfl  E  PSD.  Then 


M  = 


f  0  — A1W2  2AitJ3  ^ 

2A2W1  0  — 2A2U.'3 

\  —  A3U.’1  A3U^2  0 


The  assumption  that  M  is  positive  semi-definite  implies  its  corresponding  off-diagonal 
elements  must  add  to  zero,  so 


2A2W1  —  A|W2 


2AjW3  —  A3U>j 


2A2W3  —  A3W2 
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The  product  of  the  left-hand  sides  equals  the  product  of  the  right-hand  sides,  so  we  have 

8Ai  —  Ai 

Dividing  both  sides  AiWi  and  factoring,  we  get 

(2A2tJ3)(4A2u;3)  =  (A3u;2)(A3u;2)- 

Substituting  via  the  necessary  conditions  of  positive  semi-definiteness  (above)  and  can¬ 
celling  the  left-hand  factors,  we  obteiin  the  contradiction 

4A2tU3  =  A3U>2  =  2A2t<^3. 

Accordingly,  M  cannot  be  positively  scaled  to  be  positive-semi  definite. 

3.  Elementary  properties  of  row  (and  column)  sufficient  matrices 

To  avoid  being  overly  tiresome,  we  state  the  proofs  of  the  following  simple  propositions 
rather  tersely. 

Proposition  1.  Let  u,  u  €  be  arbitrary  and  let  P  be  an  arbitrary  n  x  n  permutation 
matrix.  Then 

P^{u  *  v)  =  {P\)  *  {P\). 

Proof.  This  is  obvious.  ■ 

Proposition  2.  Let  M  €  be  arbitrary  and  let  P  be  an  arbitrary  n  x  n  permutation 
matrix.  Then,  for  all  r  G  il" 

P^ix  *  (Mx))  =  (P'^x)  *  ((P^MP)(pTr)). 

Proof.  This  follows  at  once  from  Proposition  1  and  the  fact  that  PP^=  I.  ■ 

By  a  pTincipal  rearrangement  of  M  €  we  mean  a  matrix  of  the  form  P^AIP  where  P 

is  a  permutation  matrix. 

Proposition  3.  Every  principal  rearrangement  of  a  row  (column)  sufficient  matrix  is  row 
(column)  sufficient. 

Proof.  This  is  clearly  a  consequence  of  Proposition  2  and  the  definition  of  row  (column) 
sufficiency.  ■ 

Proposition  4.  Let  M  G  be  arbitrary  and  let  D  —  Diag(<^i , . . .  ,  <^„ )  be  any  u  x  n 

diagonal  matrix.  Then  for  all  x  £  R" 

X  *  ({DMD)x)  =  [Dx)  ♦  [M(Dx)). 
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Proof.  We  show  that  the  i-th  component  of  the  vector  on  each  side  is  the  same.  Indeed, 
for  all  i  =  1, . . . ,  n 


X  ♦  ((DMI>)x)]. 


Xi(DMDx)i 

I.  j 

n 

i=i 

[(Px)  *  (M(i)x))], . 


Proposition  5.  If  M  6  is  row  (column)  sufficient,  then  so  is  DMD  where  D  is  a 

conformable  diagonal  matrix. 

Proof.  This  is  immediate  from  Proposition  4  and  the  definitions.  ■ 

Proposition  6.  Each  nonempty  principal  submatrix  of  a  row  (column)  sufficient  matrix 
is  row  (column)  sufficient. 

Proof.  Let  M  G  be  row  (column)  sufficient.  If  q  =  (Qi,...,afc)  is  an  index  set 

contained  in  {l,...,n},  the  corresponding  principal  submatrix  of  M  is  denoted  Maa’>  h 
consists  of  the  rows  and  columns  of  M  whose  indices  belong  to  a.  Now  suppose  there  exists  a 
vector  y  G  such  that  y*{Mj^y)  <  0.  Then  define  x  G  such  that  Xq  =  y,  and  I5  =  0. 
Then  x  *  (MTx)  <  0.  Hence  when  M  is  row  sufficient,  it  follows  that  x  *  (M^x)  =  0,  but 

(x  *  (M'^x))^  =  y  *  (Mj„y). 

The  same  sort  of  argument  does  the  job  for  column  sufficiency.  ■ 

This  proposition  implies  that  the  classes  of  row  sufficient  matrices  and  column  sufficient 
matrices  (and  hence  sufficient  matrices)  are  complete  in  the  sense  given  above.  The  are 
also  subclasses  of  Pq. 

Proposition  7.  Every  row  (column)  sufficient  matrix  has  nonnegative  principal  minors. 
Proof.  This  was  shown  in  [6].  ■ 

Proposition  8.  Let  a  and  h  denote  arbitrary  real  numbers  whose  product  is  negative. 
Then  the  2x2  matrix 


is  both  row  and  column  sufficient.  The  matrix  M  does  not  belong  to  P  and  \{  a  -\-  h  ^  D, 
then  M  is  also  not  positive  semi-definite. 
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Proof.  The  fact  that  M  is  both  row  and  column  sufficient  is  obvious  from  the  definitions. 
It  is  also  obvious  that  Af  cannot  be  a  P-matrix.  If  M  were  positive  semi-definite,  the 
condition  a  -|-  ?)  =  0  would  follow  from  the  fact  that  it  has  a  zero  diagonal  entry.  ■ 

Proposition  9.  Let  a  and  b  be  real  ntimbers  such  that  a  >  0  and  6^0.  Then  a  matrix 
of  the  form 


cannot  be  row  sufficient.  Its  transpose  cannot  be  column  sufficient. 

Proof.  For  such  a  matrix  it  is  possible  to  find  a  vector  x  such  that  x  *  (A/Tr)  <  0  and 
X2(A/^x)2  <  0.  Hence  AI  cannot  be  row  sufficient.  By  the  same  token,  A^^  cannot  be 
column  sufficient  ■ 

The  next  proposition  is  noteworthy  for  algorithmic  reasons. 

Proposition  10.  Let  AI  £  be  row  sufficient.  If,  for  some  z,  m,,  =  0  and  rriji  >  0  for 
all  j  =  1 . n,  then  m,j  <  0  for  all  j  =  1, . . . ,  n. 

Proof.  By  Proposition  6,  it  suffices  to  prove  this  assertion  for  the  case  where  n  =  2.  By 
Proposition  3,  it  is  not  restrictive  to  cissume  that  i  =  1.  The  case  where  m2i  =  0  is  ruled 
out  by  Proposition  9.  Thus.  m2i  >  0.  By  Proposition  7,  the  condition  mi2  >  0  cannot 
hold,  so  the  desired  conclusion  follows.  ■ 

Section  1  contains  an  allusion  to  the  fact  that  row  sufficient  matrices  also  belong  to  the  class 
Qo.  This  was  proved  in  [6].  Although  column  sufficient  matrices  also  enjoy  an  interesting 
property  with  respect  to  the  LCP,  they  do  not  form  a  subcleiss  of  Qq.  This  can  be  seen 
from  the  example 


It  is  easy  to  see  that  this  matrix  is  column  sufficient  (in  fact,  column  adecpiate).  But 
th('  union  of  the  corresponding  complementary  cones  is  not  convex,  and  hence  M  ^  Qq. 
This  observation  may  explain  why  in  this  paper  we  devote  more  attention  to  row  sufficient 
matrices. 
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4.  Principal  pivoting 

As  its  name  suggests,  the  principal  pivoting  method  is  based  upon  the  algebraic  process  of 
principal  pivoting  which  we  shall  briefly  review.  (See  also  [5],  [4].)  Once  this  is  done,  we  can 
develop  theorems  on  the  invariance  of  row  and  colunm  sufficiency  under  principal  pivoting. 
Such  results  are  essential  for  the  application  of  the  PPM  to  linear  complementarity  problems 
of  this  sort. 

Consider  an  affine  transformation  of  the  form  2  e-f  tc  =  g  +  Mz  where  M  G  and 

<7  G  /?".  For  this  discussion,  the  only  special  property  required  of  M  is  that  for  some  index 
set  a  C  {1, . . . ,  n}  the  principal  submatrix  Mca  be  nonsingular.  For  notational  ease,  we  also 
assume  that  Mca  is  a  leading  principal  submatrix  of  M .  This  is  not  a  restrictive  assumption, 
as  it  can  be  brought  about  by  relabeling.  Now  consider  the  equation  w  —  q  Mz  '\n 
partitioned  form: 


Qot  “h  "h 

(6) 

^'c,  =  93,  +  MccZo  +  McaZa 

In  this  representation,  the  2-variables  are  nonbasic  (independent)  and  the  ui-variables  arc 
basic  (dependent). 

Since  Mac,  is  nonsingular  by  hypothesis,  we  may  exchange  the  roles  of  Wa  and  Za  thereby 
olitaining  a  system  of  the  form 


9a  +  ^^aa^o  d"  __ 

(  '  ) 

=9'a+ 

where 

9a  =  -K-j9a  M'c  =  M-J  MU  =  -M-jMc, 

q'a  =  93  -  MaaM-Jqc  A/'^  =  M'^^  =  Maa  -  MaaM;^  Mca 

Definition.  The  system  (7)  is  said  to  be  obtained  from  (6)  by  a  •principal  pivotal  trans¬ 
formation  m  the  matrix  Mac-  In  this  process,  the  matrix  Mca  is  called  the  pivot  block. 

This  terminology  also  applies  to  the  matrices  M  and  M'  alone.  To  indicate  that  M'  is 
a  principal  pivotal  transform  of  M  with  respect  to  the  index  set  a  (and  the  nonsingular 
principal  submatrix  Mac),  we  write 


A/'  =  pc{M). 


Another  notion  we  shall  need  is  that  of  a  sign-changing  matrix.  Once  again,  let  o  and  a  de¬ 
note  complementary  index  sets  in  {1, ... ,  n}.  Let  Sa  be  the  diagonal  matrix  Diag(<7i . <7,, ) 

such  that  for  ?  =  1, . .  .  ,n 

(  1  e  G  a 

(T,  =  < 

1-1  r  G  Of 
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These  two  notations  come  together  in  the  following  result.* 

Theorem  1.  Let  M  G  have  the  nonsingular  principal  submatrix  M^a-  Then 

=5e,(p.(M'r))55.  (9) 

Proof.  This  formula  follows  from  an  essentially  routine  calculation  that  makes  use  of  the 
folh)wing  facts; 

1.  Pre-  and  postmultiplication  by  5*  chamges  the  signs  of  the  off-diagonal  blocks  but 
not  the  diagonal  blocks. 

2.  = 

3. 

4. 


\\V  ar('  mainly  interested  in  the  effect  of  principal  transformation  on  row  sufficient  matrices, 
but  it  is  convenient  to  treat  the  column  sufficient  case  first. 

Theorem  2.  Let  be  a  nonsingular  principal  submatrix  of  A/  G  /?’**".  If  A/  is  cohimn 
sufficient  and  M'  =  ^:).,(A/),  then  M’  is  also  colmnn  sufficient. 

Proof.  .As  remarked  earlier,  it  is  not  restrictive  to  assume  that  the  pivot  block  is  a  leading 
I)rincipal  submatrix  of  A/.  Let  ij  =  A/'.^  and  suppose  r  *  y  <  0.  We  may  write 


The  condition  .r  +  ij  <  0  means 


Since  A/'  =  we  have 


'  riiis  II  •y  bo  known,  bnl  I  don’t  roc 


a  sonrro  for  it 
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But  M  is  cc'umn  sufficient,  >o  it  follows  that 


Accordingly,  x  *  y  =  0  which  implies  that  M'  is  column  sufficient.  ■ 

\Vc  now  come  to  the  result  we  really  want. 

Theorem  3.  Let  Maa  be  a  nonsingalar  principal  submatrix  of  M  £  If  A/  is  row 

sufficient  and  A/'  =  pa{M),  then  A/'  is  also  row  sufficient. 

Proof.  It  is  obvious  from  first  principles  that  a  matrix  is  row  sufficient  if  and  only  if  its 
transpose  is  column  sufficient.  Thus,  it  suffices  to  prove  that  (Af')^  is  column  sufficient. 
Our  hj-pothesis  implies  that  A/^  must  be  so.  Theorem  2  implies  that  pa{M^)  is  column 
sufficient.  By  the  definition  of  M'  and  by  equation  (9)  we  have 

iMy=  {p.(A/)f  = 

The  result  now  follows  from  Proposition  5.  ■ 

In  light  of  Theorems  2  and  3,  we  say  that  column  and  row  sufficient  matrices  are  invariant 
under  principal  pivoting.  In  other  words,  when  one  performs  a  principal  pivot  operation 
on  a  row  (column)  sufficient  matrix  the  resulting  matrix  is  again  row  (column)  sufficient. 
These  invririance  theorems  generalize  early  results  on  principal  pivotal  transforms  of  P- 
rnatrices  and  PSD-matrices.  (See  [10],  [3].)  There  is  no  counterpart  for  adequate  matrices 
since  it  is  not  true. 

We  close  this  section  with  a  generalization  of  two  technical  results  [4,  Theorem  4  and 
Theorem  4']  that  have  very  important  bearing  on  a  version  of  the  PPM. 

Theorem  4.  Let  .4  be  2  x  2  matrix  with  the  following  properties; 

(»)  <  0; 

( ii)  ttji  <  0; 

(iti)  an  +021  <  0; 

I  tv)  if  O] I  <  0,  then 


1  /  ~'2i2  1 

^11  \  Q11O22  —  Qi2^21  ®21 


is  row  sufficient; 
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( ii)  if  021  <  0,  then 


A-i  := 


an 

1 


012021  —  011022 
—022 


is  colomn  sufficient. 

Thru  A  must  have  the  following  properties: 

( I'*)  oii  >  0; 

[  vii)  oji  >  0: 

(  inn )  (/i2  +  O22  >  0- 

Proof.  Suppose  Ou  <  0.  Then  as  At  is  row  sufficient,  012  >  0  and  det.4i  >  0.  Hence 

(  1  (—012021  +  0(2021  —  OHO22)  =  022  >  0. 

Vou/ 

If  0,2  =  022  =  O'  then  .4i  has  a  zero  column  and  hence  cannot  be  row  sufficient,  a  contra¬ 
diction.  Thus,  012  +  022  ^  0.  Now  suppose  021  <  0.  We  may  (and  do)  assume  on  =  0. 
Sincf  .42  is  column  sufficient,  it  follows  that  022  >  0  and  det  A2  >  0.  Thus, 

( — )  (—012021)  >  0. 

\02i/ 

This  implies  012  >  0.  If  O12  =  022  =  0,  then  A2  cannot  be  column  (or  row)  sufficient,  again 
a  (■(mtradiction.  This  means  that  012  +  022  >  0.  B. 


5.  The  Principal  Pivoting  Method 

■As  matters  pre.sently  stand,  there  are  two  versions  of  the  principal  iiivoting  method 
''ymmetric  and  a.syinmetric — both  of  which  can  be  applied  to  linear  complementarity  jirob- 
lems  (q.  M )  with  either  a  PSD-matrix  or  a  P-matrix.  The  latter  ca.se  is  much  simpler  th;m 
tlie  former  because  it  does  not  require  the  use  of  certain  precautions.The.se  diffennees  will 
beeome  apparent  in  due  course. 

Like  nunif'rous  other  algorithms,  the  PPM  works  with  pivotal  transforms  of  tlu'  system 

w  =  q  +  M  z.  (10) 

In  the  <leveloi)ment  below,  we  use  the  superscript  u  as  an  iteration  counter.  The  initial 
value  of  )/  will  be  0,  and  the  system  shown  in  (10)  will  be  written  as 

w°  =  q^  +  (11) 
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In  general,  after  principal  pivots,  the  system  will  be 

w‘'  =  q‘'  + 


(12) 


Generically,  the  vectors  and  z*',  which  represent  the  system’s  basic  ^lnd  nonbasic  vari¬ 
ables,  respectively,  may  each  be  composed  of  ta  and  z  variables.  Principal  rearrangements 
can  be  used  to  make  =  {ta,, 2^}  i 

The  systems  (12)  can  also  be  represented  in  the  familiar  tableau  form 


1 

< 

mjCi 

•  *  * 

9n 

»^nl 

•  .  • 

'^nn 

This  way  of  presenting  the  PPM  is  just  an  expository  convenience.  Tableaux  are  not 
essential;  the  algorithm  can  make  use  of  a  “revised  simplex  approach,”  analogous  to  what 
has  been  done  in  an  implementation  Lemke’s  method. 

The  symmetric  version  of  the  PPM  uses  principal  pivotal  transformations  (of  order 
1  or  2)  in  order  to  achieve  one  of  two  possible  terminal  sign  configurations  in  the  tableau. 
The  first  is  a  nonnegative  “constant  column”,  that  is,  q'-  >  0  for  all  i  =  1, . . .  ,n.  The  other 
is  a  row  of  the  form 


q^  <  0  and  <0  j  =  1, . . . ,  n. 

The  first  sign  configuration  signals  the  discovery  of  a  solution  to  (g,Af).  The  second  sign 
configuration  indicates  that  the  problem  has  no  feasible  solution.  The  PPM  (as  originally 
conceived)  does  not  actually  check  for  this  condition.  It  cannot  occur  when  AI  is  a  P- 
matrix.  When  M  is  PSD,  it  can  be  inferred  from  the  condition 

q^  <  0,  =  0  and  m*',.  >0  Vi  ^  r, 

which  M  checked  in  the  “minimum  ratio  test.”  The  key  observation  is  that  the  same 
inference  can  be  made  when  M  is  (row)  sufficient.  (See  Propositions  6,7,  and  10  and 
Theorem  3.) 

The  PPM  consists  of  a  sequence  of  major  cycles,  each  of  which  begins  with  the  selection  of  a 
distinguished  variable  whose  value  is  currently  negative.  That  variable  remains  the  one  and 
only  distinguished  variable  throughout  the  major  cycle.  The  object  during  the  major  cycle 
is  to  make  the  value  of  the  distinguished  variable  increase  to  zero,  if  possible.  Each  iteration 
involves  the  increase  of  a  nonbasic  variable  in  an  effort  to  drive  the  distinguished  variable 
up  to  zero.  This  increasing  nonbasic  variable  is  called  the  driving  variable.  According  to 
the  rules  of  the  method,  all  variables  whose  values  are  currently  nonnegative  must  remain 
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so.  The  initial  trial  solution  is  =  (9®,0),  hence  at  least  n  of  the  variables  must  be 

nonnegative.  For  those  variables  whose  initial  value  is  <  0,  we  impose  a  negative, 
lower  bound  X  where 

A  <  min  {of}. 

This  artifice  is  used  in  all  cases  except  where  M  G  P.  Then,  in  addition  to  requiring  all 
variables  with  currently  iionnegative  values  to  remain  so,  the  PPM  also  demands  that  the 
variables  currently  having  a  negative  value  remain  at  least  as  large  as  A.  To  accommodate 
this  feature,  we  broaden  the  notion  of  basic  solution  by  allowing  the  nonbasic  variables  to 
have  the  value  0  or  A.  (See  [2],  [3],  [4].)  We  also  say  that  a  solution  of  the  system  (10)  is 
nondegenerate  if  at  most  n  of  its  2n  variables  have  the  value  0  or  A.  Otherwise,  the  solution 
is  called  degenerate. 

In  the  interest  of  clarity,  it  will  help  to  introduce  the  following  notations.  We  want  to 
distinguish  between  the  names  of  variables  and  their  values.  To  this  end,  we  use  bars 
over  the  generic  variable  names  u',"  and  z,  to  indicate  definite  values  of  these  variables.  At 
the  beginning  of  a  major  cycle  in  which  negative  lower  bounds  A  are  in  use.  we  will  have 
c,"  =  0  or  zl'  =  A  i  =  1 . ri.  Next,  we  use  the  notation 

JV‘'(z^}  =  q‘'+M^z‘'. 

The  definition  of  the  mapping  U'*"  is  the  same  as  that  of  but  it  emphasizes  the  argument 

A  simple  example  will  help  to  motivate  preceding  ideas,  especially  the  need  for  the  negative 
lower  bounds,  A.  Consider  the  LCP  of  order  2  in  which 

/  0  2 
and  M  =  I 

V-1  1 

The  matrix  M  is  sufficient,  i.e.,  row  and  column  sufficient.  At  the  outset  we  have  (jr°.  z^)  — 
(  —  3. —2.0.0).  Suppose  we  choose  lef  as  the  initial  distinguished  variable.  Then  cf  would 
!)(■  used  as  the  initial  driving  variable.  If  only  nonnegative  variables  are  required  to  remain 
nonnegative,  there  would  be  no  limit  to  the  allowable  increase  of  the  driving  variabh'.  Uiuler 
ordimu-y  circumstances,  such  an  outcome  would  indicate  that  the  problem  is  unsolvable  (at 
l('ast  by  this  method).  But  notice  that  this  LCP  has  the  solution  (?e,  z)  =  (1.0. 0,2).  Henc<' 
some  sort  of  modification  is  needed. 

If.  at  the  outset  of  a  major  cycle,  the  selected  distinguished  variable  is  basic,  the  first  driving 
variable  is  the  cmnplement  of  the  distinguished  variable.  Thus,  if  ir''  is  the  distinguislK'd 
variable  for  the  current  major  cycle,  then  z^  is  the  first  driving  variable,  Tlu'  distinguislu'd 
variable  need  not  be  a  basic  variable,  however.  Thus,  with  the  broad<'r  dc-finition  of  l)asic 
solution  (given  above),  the  current  solution  (w'',z‘')  may  have  c)'  =  A  <  0  at  the  beginning 
of  a  major  cycle.  In  such  circumstances,  can  be  the  distinguished  varial)le  as  w('ll  as  the 
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driving  variable.  In  this  event,  the  increase  of  the  driving  variable  will  always  be  blocked, 
either  when  a  basic  variable  reaches  its  (current)  lower  bound  (0  or  A)  or  when  reaches 
zero  (in  which  case  the  major  cycle  ends). 

The  following  is  a  formal  statement  of  this  algorithm. 

Symmetric  PPM  with  Nondegeneracy  Assumption  in  Force 


Step  0.  Set  1/  =  0;  define  (u;'’,  z°)  =  (g°,0).  Let  A  be  any  number  less  than  min,  5°. 

Step  1.  If  9*'  >  0  or  if  (ty*',  z^')  >  (0, 0),  stop;  (w'',  z*')  :=  (9",  0)  is  a  solution.  Otherwise^, 
determine  an  index  r  such  that  =  A  or  (if  none  such  exist)  an  index  r  such  that 
<  <  0. 

Step  2.  Let  Cr‘'  be  the  largest  value  of  z'^  >  z"  satisfying  the  following  conditions; 


(i) 

z;r  <  0  if  z;:  =  a. 

(ii) 

=  1/  =u 

■  •  •>  ■^r  ’  +  •  • 

. ,  z;;)  <  0  if  <  <  0. 

(iii) 

wrizi.. 

2^'  2‘'  2*' 

■  •  1  ^r-11  +  •  • 

.,z;;)  >  0  if  <  >  0. 

(iv) 

W^zl.. 

■  •  1  *r-n  -‘r  ’  -^r+l’  •  ' 

.,2n)  ^  <  0- 

Step  3.  If  Cr  =  +20,  stop.  No  feeisible  solution  exists.  If  =  0,  let  =  0,  zj"^'  =  zj' 
for  alH  ^  r,  and  let 

Return  to  Step  1  with  v  replaced  by  1/  +  1.  If  0  <  <  -f  00,  let  s  be  the  unique 

index  determined  by  the  conditions  (ii),  (iii),  and  (iv)  in  Step  2. 

Step  4.  If  >  0,  perforin  the  principal  pivot  {w^,z'^).  Let 


,‘'+1  _ 


ir;(zr,...,zr_„C,^ri,---,^n)  and  =  W‘'+\z‘'^^). 


If  s  =  r,  return  to  Step  1  with  u  replaced  u  +  1.  If  s  ^  r,  return  to  Step  2  with 
u  replaced  1/  +  1.  If  rn!^,  =  0,  perform  the  principal  pivot  {(u)^,zjf),  (iy|f,z;()}.  Put 
u.j;+'  =  all  i  ^  and  then  te,*"'’*  =  W^‘"^'(z‘'+’) 

for  all  i  ^  {r,  .s}.  Return  to  Step  2  with  u  replaced  by  1/  +  1  and  r  replaced  by  s. 


Discussion 

Here  we  wish  to  discuss  what  algorithm  does  and  why  it  actually  processes  any  LCP  with 
a  row  sufficient  matrix,  M. 

^At  the  beginning  of  a  major  cycle,  for  each  index  r,  at  most  one  of  w’p ,  can  be  negative. 
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All  major  cycles  of  the  PPM  begin  at  Step  1  were  the  algorithm  checks  whether  it  is  possible 
to  terminate  with  a  solution.  This  will  be  the  case  if  {w'',z‘')  >  (0,0)  since  must 

then  be  a  nonnegative  solution  of  (10)  with  z''  =  0.  As  illustrated  in  Example  2  (below), 
it  can  happen  that  the  constant  column  becomes  nonnegative  before  z''  does.  In  such  a 
case,  resetting  z''  to  zero  yields  a  solution.  If  neither  of  these  forms  of  termination  occurs, 
there  is  an  index  r  such  that  z^  <  0  or  <  0  and  it  becomes  the  distinguished  variable 
for  the  current  major  cycle. 

For  a  linear  complementarity  problem  {q,M)  of  order  n,  there  are  2n  variables  in  equation 
(10).  The  number  of  negative  components  in  a  solution  of  (10)  is  called  its  index  of 
infeasibiliiy.  The  conditions  imposed  in  Step  2  of  the  Symmetric  PPM  prevent  this  number 
from  increasing.  Furthermore,  with  each  return  to  Step  1,  the  algorithm  produces  a  basic 
solution  having  a  smaller  index  of  infeasibility  than  its  predecessor.  Since  there  are  at  most 
a  finite  number  of  basic  solutions,  there  can  be  at  most  finitely  many  returns  to  Step  1. 
The  proof  of  finiteness  therefore  boils  down  to  showing  that  each  major  cycle  consists  of 
at  most  a  finite  number  of  steps. 

Termination  can  also  occur  in  Step  3.  In  this  event,  =  +oo.  For  this  to  happen,  the 
distinguished  variables  must  be  U)^;  it  must  also  be  true  that 

=  0  ^  0  Vt-T. 

From  Proposition  10,  it  follows  that  m'^j  <  0  j  =  1, . . .  ,n.  Now,  since  f J  <  0  for  all  j  and 

>'■<  =  ?t  +  i:  <0. 

J=1 

it  follows  that  q'^  <  0,  so  that  the  r-th  equation 

has  no  nonnegative  solution.  Another  outcome  in  Step  3  is  that  =  0  in  which  case 
(by  nondegeneracy)  the  distinguished  variable  and  the  driving  variable  must  have  been  z'^ 
which  increased  to  zero.  This  brings  the  major  cycle  to  a  close  without  necessitating  a 
I)ivot.  The  remaining  possibility  0  <  Cr  <  means  that  some,  basic  variable  blocked  the 
increase  of  z^ . 

The  various  alternatives  that  arise  in  the  latter  situation  are  addressed  in  Stej)  4.  If  >  0. 
the  indicated  principal  pivot  is  executable.  If  s  =  r,  the  distinguished  variable  must  have 
increased  to  0.  This  brings  about  a  return  to  Step  1  and  a  reduction  in  the  index  of 
infeasibility  by  at  least  one.  If  s  ^  r,  the  principal  pivot  is  made  and  the  incr(‘a.se  of  the 
driving  variable  continues  in  accordance  with  the  rules  of  Step  2.  If  =  0.  then  ^  r. 
The  fact  that  blocked  z^  means  <  0.  The  principal  pivot  of  ordc'r  2  is  executable 
because  the  row  sufficiency  of 
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and  the  negativity  of  implies  that  >  0.  (See  Proposition  9.)  The  values  of  the 
\'ariables  immediately  after  the  pivot  are  those  they  had  when  blocking  occurred.  At  the 
return  to  Step  2,  the  variable  w'^  becomes  a  principal  rearrangement  to  restore  the 
natural  order  of  subscripts  would  be  possible. 

As  noted  above,  the  argument  that  the  algorithm  will  process  any  nondegenerate  LCP 
with  a  row  sufficient  matrix  comes  down  to  showing  that  there  can  be  at  most  finitely 
many  returns  to  Step  2.  But  this  is  clear  from  the  fact  that  there  are  only  finitely  many 
principal  transformations  of  the  system  and  finitely  many  ways  to  evaluate  the  nonbeisic 
variables  (i  ^  r).  As  for  Zr,  its  value  and  that  of  its  complement  increase  monotoni- 
cally  and  their  sum  increases  strictly  throughout  the  major  cycle.  Hence  the  definition  of 
Cr  and  (k  >  0)  make  it  impossible  to  have  (t  =  and  z^'  =  (t  ^ 

r)  as  would  have  to  be  the  case  with  infinitely  many  steps  within  a  major  cycle. 

Example  2.  Consider  the  LCP  (g,  M)  where 

/  0  -1  2 
and  Af  =  2  0—2 

^  -1  1  0 

The  PPM  applies  to  this  problem  because  the  matrix  M  is  sufficient  (as  shown  in  Example 
1).  It  is  easy  to  verify  that  (g,M)  has  the  solution  (u>;  r)  =  (2,0,0;  0, 1,3).  The  discussion 
below  illustrates  how  this  solution  can  be  obtained  by  the  symmetric  version  of  the  PPM. 
The  reader  is  advised  that,  for  simplicity,  the  superscripts  (iteration  counters)  and  bars 
(denoting  fixed  values  of  variables)  are  omitted. 

For  this  choice  of  data,  the  problem  {q,M)  has  the  tabular  form 

lei 
W2 

l«3 

The  number  A  =  — 4  will  serve  as  the  negative  lower  bound  for  the  initial  negative  basic 
variables  Wi  and  u>3.  Choose  Wi  as  the  distinguished  variable  and  its  complement  rj  as 
the  driving  variable.  The  blocking  vjiriable  is  1^3  which  decreases  and  reaches  its  lower 
bound  —4  when  zi  increases  to  3.  Since  the  corresponding  diagonal  entry  77133  equals  0,  it 
is  necessary  to  perform  a  principal  pivot  of  order  2:  {w3,zi)  and  (11)1,23).  The  new  tableau 
is 


1 

Zl 

Z2 

Z3 

-3 

0 

-1 

2 

6 

2 

0 

-2 

-1 

-1 

1 

0 

16 


1 

103 

22 

Wi 

23 

3 

2 

0 

1 

2 

1 

2 

W2 

1 

-2 

1 

-1 

2l 

-1 

-1 

1 

0 

-4 

0 

-3 

Now  the  distinguished  variable  Wi  is  nonbasic  and  can  be  increased  directly  as  the  driving 
variable.  In  this  case,  the  driving  variable  blocks  itself.  Thus,  the  first  major  cycle  ends 
with  the  tableau 


1 

W3 

22 

ICl 

23 

3 

2 

0 

1 

2 

1 

2 

W2 

1 

-2 

1 

-1 

2l 

-1 

-1 

1 

0 

-4 

0 

0 

For  the  next  major  cycle,  the  only  possible  distinguished  variable  is  1^3  which  is  nonbasic 
at  value  —4.  This  becomes  the  driving  variable  and  is  blocked  when  it  reaches  —1  and  Zi 
decreases  to  0.  Once  again  a  principal  pivot  of  order  2  is  needed.  It  leads  to 


1 

2l 

22 

23 

Wi 

-3 

0 

-1 

2 

W2 

6 

2 

0 

-2 

W3 

-1 

-1 

1 

0 

0  0  f 


Here  the  driving  variable  is  the  23  which  starts  from  the  value  |;  it  is  blocked  when  it 
reaches  3  and  W2  decreases  to  0.  This  time  the  algorithm  performs  a  different  principal 
pivot  of  order  2;  (1^2,23)  and  (1^3, 02)-  This  yields 


1 

2l 

1^3 

W2 

Wi 

2 

1 

-1 

-1 

23 

3 

1 

0 

1 

2 

22 

1 

1 

1 

0 

0 

-1 

0 

The  distinguished  variable  is  still  1^3  whose  current  value  is  —1.  If  used  as  the  driving 
variable,  it  will  block  itself  and  a  solution  will  be  obtained.  Another  option  is  to  oIjsctvc 
that  the  “constant  column”  is  positive.  In  such  a  case  the  negative  basic  variable! s)  can 
be  set  equal  to  zero.  Either  way,  the  solution  found  is  (u);c)  =  (2,0,0;0, 1,3). 

The  asymmetric  version  of  the  PPM  also  consists  of  a  major  cycles.  Instead  of 
executing  only  principal  pivots  of  order  1  or  2,  each  major  cycle  involves  a  sequence  of 
“simple  pivots”  whose  effect  may  be  a  principal  pivot  of  larger  order.  The  rules  governing 
blocking  are  the  same  as  those  in  the  Symmetric  PPM  (nonnegative  variables  are  bounded 
below  by  0,  and  negative  variables  are  bounded  below  by  A.  A  negative  driving  varialde 
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is  bounded  above  by  0.)  The  main  difference  between  the  two  versions  of  the  algorithm 
is  that  in  the  asymmetric  one  entails  pivotal  exchanges  between  the  driving  variable  and 
the  driving  variable  and  then  takes  the  new  driving  variable  to  be  the  complement  of  the 
blocking  variable.  Just  as  in  the  positive  semi-definite  case  [4],  the  distinguished  variable 
and  the  driving  variable  increase  monotonically  and  their  sum  increases  strictly.  This 
assertion  is  can  be  proved  by  using  Theorem  4.  We  omit  further  details  and  simply  point 
out  th  .t  the  argument  used  to  justify  the  aysmmetric  version  of  the  PPM  for  PSD  matrices 
carries  over  mutatis  mutandis  to  the  row  sufficient  case. 
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